Flash / Phase-Change Memory in Multi-Ring Topology Using Serial-Link Packet Interface

ABSTRACT

A multi-ring memory controller sends request packets to multiple rings of serial flash-memory chips. Each of the multiple rings has serial flash-memory chips with serial links in a uni-directional ring. Each serial flash-memory chip has a bypassing transceiver with a device ID checker that bypasses serial packets to a clock re-synchronizer and bypass logic for retransmission to the next device in the ring, or extracts the serial packet to the local device when an ID match occurs. Serial packets pass through all devices in the ring during one round-trip transaction from the controller. The average latency of one round is constant for all devices on the ring, reducing data-dependent performance, since the same packet latency occurs regardless of the data location on the ring. The serial links can be a Peripheral Component Interconnect (PCI) Express bus. Packets have modified-PCI-Express headers that define the packet type and data-payload length.

RELATED APPLICATION

This application is a continuation-in-part (CIP) of the co-pending application for “PCI Express-Compatible Controller and Interface for Flash Memory”, U.S. Ser. No. 10/803,597, filed Mar. 17, 2004. This application is also related to “Serial Interface to Flash Memory Chip using PCI-Express-Like Packets and Packet Data for Partial-page Writes”, U.S. Pat. No. 7,130,958, filed Feb. 9, 2004.

FIELD OF THE INVENTION

This invention relates to memory systems, and more particularly to a memory controller and memory chips that are connected together by one or more rings of high-speed serial links.

BACKGROUND OF THE INVENTION

Flash memory has gained wide acceptance for its non-volatile storage, which is ideal for portable devices that may lose power, since the data is not lost when stored in the flash memory. Flash memories are constructed from electrically-erasable programmable read-only memory (EEPROM) cells.

Rather than use a randomly-addressable scheme such as is common with dynamic-random-access memory (DRAM), many flash memories use a block-based addressing where a command and an address are sent over the data bus and then a block of data is read or written. Since the data bus is also used to send commands and addresses, fewer pins are needed on the flash-memory chip, reducing cost. Thus flash memory is often used as a mass-storage device rather than a randomly-addressable device.

Universal-Serial-Bus (USB) has become a popular standard interface for connecting peripherals to a host such as a personal computer (PC). Peripheral Component Interconnect (PCI), Personal-Computer Memory Card International Association (PCMCIA) and PCI-Express are other bus and card standards. USB-based flash-memory storage devices or “drives” have been developed to transport data from one host to another, replacing floppy disks. While large external flash drives may be used, smaller USB flash drives known as key-chain or key drives have been a rapidly growing market.

A USB flash-memory device such as a key drive can be constructed from a microcontroller, a flash-memory controller or interface, and one or more flash-memory chips. A serial interface on the microcontroller connects to the USB bus to the host, and data from the serial interface is transferred through the microcontroller to the flash controller and then written to the flash-memory chips.

FIG. 1 shows a prior-art interface to a flash-memory chip. Flash-memory chip 12 has 8-bit I/O bus 14 that connects to controller 10. Controller 10 could be a microcontroller in a flash drive or a flash-memory card. Address, data, and commands are sent over 8-bit I/O bus 14 to flash-memory chip 12 using time-multiplexing. Eight bits of address, data, or command information can be transferred in parallel at a time over 8-bit I/O bus 14.

Several control signals on control bus 16 are used to coordinate transfer of address, data, and commands over 8-bit I/O bus 14. For example, an address-strobe signal can indicate when address signals can be latched into flash-memory chip 12, and a data strobe can indicate when data from flash-memory chip 12 can be latched by controller 10.

Although 8-bit I/O bus 14 is much more compact than if separate address and data buses were used, for some applications even the 8-bit bus is less than ideal. When the pins needed by 8-bit I/O bus 14 and flash-memory chip 12 are counted, as many as 16 signal pins are used for the interface to flash-memory chip 12. Several power and ground pins may be needed, so the total pin count of flash-memory chip 12 is over 20 pins. Also, these 20 pins need to be added to controller 10, increasing its pin count.

While chips with 20 or 30 pins are acceptable for many applications, some applications are more sensitive and could benefit by a further reduced pin count. For example, small devices such as flash-memory cards and flash drives are very small and benefit from further reductions in the pin counts, since a reduced pin count can reduce chip package sizes of both flash-memory chip 12 and controller 10, and can reduce the wiring needed and the size of a printed-circuit board (PCB) that flash-memory chip 12 and controller 10 are mounted on. Controller 10 and flash-memory chip 12 can be integrated together as a single integrated circuit (IC) with reduced pin count.

Memory devices are sometimes chained together in a daisy chain. For example, fully-buffered dual-inline memory modules (FB-DIMM) links modules that re-transmit data to downstream modules. Unfortunately, the module that is the farthest away from the host's memory controller has a large latency since data must be retransmitted by all other modules in the daisy chain. This latency problem puts a limit on the number of memory modules that can be chained together.

What is desired is to reduce both latency and the pin count of a flash-memory chip by using a serial interface rather than a parallel interface. A serial interface to a flash-memory chip is desirable. A serial interface using packets to access a flash-memory chip is desirable. It is desired to modify a standardized serial interface for use with a flash-memory chip. A specialized serial interface to a flash-memory chip that is based on a standard serial-bus interface is desirable. It is further desired to reduce latency by arranging the flash-memory chips in a ring topology rather than in a daisy chain. A very high capacity memory system using serial packets sent in a ring is desirable.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a prior-art interface to a flash-memory chip.

FIG. 2 is a block diagram of a serial interface to a flash-memory chip.

FIG. 3 shows an implementation of a serial flash-memory chip in more detail.

FIG. 4 shows a memory system with devices connected together in a ring of serial links.

FIG. 5 shows a multi-ring memory system of ring serial links.

FIG. 6 shows a bypassing serial-link transceiver.

FIG. 7 is a layer diagram for communication over the serial bus to a serial flash-memory chip.

FIG. 8 is a diagram of serial-packet formation by the protocol layers of FIG.

FIG. 9 shows a transaction-layer packet.

FIG. 10 is a table of transaction-layer packet types used for communicating with serial flash-memory chips in a ring.

FIG. 11 is a table of request and response packets used for various flash-memory commands.

FIG. 12 shows a generic format for a vendor-defined message packet.

FIG. 13 shows a header for a memory-request packet.

FIG. 14 shows a header for a completion packet.

FIG. 15 shows a header for a configuration-request packet.

FIG. 16 shows packing of burst data.

DETAILED DESCRIPTION

The present invention relates to an improvement in serial-ring-linked memory systems. The following description is presented to enable one of ordinary skill in the art to make and use the invention as provided in the context of a particular application and its requirements. Various modifications to the preferred embodiment will be apparent to those with skill in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed.

Serial Link—FIG. 2

FIG. 2 is a block diagram of a serial interface to a flash-memory chip. Serial flash-memory chip 22 has a serial-bus external interface rather than an 8-bit I/O bus. Controller 20 also uses the serial-bus interface, generating serial-bus packets to access serial flash-memory chip 22. These serial-bus packets requesting access of serial flash-memory chip 22 are sent over input serial bus 24.

When data read from serial flash-memory chip 22 is ready to be sent back, serial flash-memory chip 22 packs this data in serial packets that are sent over output serial bus 26 to controller 20.

In one embodiment, serial buses 24, 26 are a Peripheral Component Interconnect (PCI) Express bus. PCI express uses two lines per direction, including a transmit differential pair PET+, PET−, and a receive differential pair PER+, PER− of data pins. Thus a total of four signal lines are used by the serial-bus interface between serial flash-memory chip 22 and controller 20. Bi-directional data transmission is possible since separate transmit and receive lines are available. The pin count of serial flash-memory chip 22 and controller 20 can be reduced, since the serial interface uses only 4 pins compared to 16 or more pins for the parallel interface of FIG. 1. The total pin count may be ten or fewer external pins.

FIG. 3 shows an implementation of a serial flash-memory chip in more detail. Serial engine 72 receives data from the differential lines of input serial bus 24, and drives differential data onto output serial bus 26. Serial engine 72 can perform serial tasks such as timing, framing, start-detection, and checksum generation and verification. Data can be converted from serial to parallel formats and the clock can be extracted from the data stream.

Parallel data from serial engine 72 is communicated with state machines or microcontroller 70, such as over an internal parallel bus. Microcontroller 70 can perform a variety of tasks, such as routines to extract and decode commands embedded in serial packets received over input serial bus 24, and routines to read, write, and erase flash memory in response to these commands. Microcontroller 70 can include a programmable microcontroller, state machines, controller blocks, custom-logic blocks, or various combinations of these components.

Serial flash-memory chip 22 includes serial engine 72, microcontroller 70, and flash memory array 80 on the same semiconductor substrate or chip. Flash memory array 80 contains the flash or EEPROM memory cells arranged as data words that match the width of an internal flash bus, such as 32, 64, or 128 bits wide. Address signals for the rows and columns are generated by address buffers and decoder 82, which is loaded with an address that is sent over an internal bus from microcontroller 70.

A command sent from microcontroller 70 is latched into command register 84. This command is decoded and activates control logic 86 to carry out a sequence of operations and generate a sequence of internal control to perform the operation, such as reading or erasing memory cells or latching an address or reporting a status back. Higher programming and erase voltages may be generated. Flash memory array 80 may be powered down when not in use by a command from microcontroller 70.

Data written into serial flash-memory chip 22 arrives from serial engine 72 and microcontroller 70 and is latched by global buffer 78, which can allow the cache-write completion packet to be sent back. The data is then sent to data buffers 76 to be driven onto flash memory array 80 for storage. Data may be temporarily held in data/cache buffers 76 while being written to flash memory array 80.

An internal bus of 8 or more parallel bits can connect the flash memory block to microcontroller 70. Addresses, commands, and data from microcontroller can be transferred over this or other internal buses. Since the internal bus between microcontroller 70 and the flash memory block does not connect directly with chip pins, except perhaps for testing purposes, the pin count of serial flash-memory chip 22 is minimized.

While serial engine 72 could send and receive data to and from the same external device, such as the host or another memory device, the inventors instead receive data from one external device, and send data to a different external device.

The external devices are connected in a ring. Serial engine 72 receives data from the differential lines of input serial bus 24 from an earlier device in the ring, and drives differential data onto output serial bus 26 to a later device in the ring.

FIG. 4 shows a memory system with devices connected together in a ring of serial links. Rather than connecting devices in a daisy chain, the devices are connected in a ring. Each device in the ring receives serial packets from an earlier device in the ring, and transmits serial packets to the following device in the ring, rather than back to the earlier device in the ring. The serial packets are sent along the ring until they reach their intended destination.

Read and write requests from host controller 820 are placed into serial packets and transmitted over ring serial links 824 to first memory device 802. First memory device 802 examines the packet and passes the packet on to second memory device 803 over ring serial links 824 when the serial packet is not addressed to first memory device 802. Second memory device 803 also examines the packet, and passes it on if the destination is not second memory device 803. If the packet is destined for second memory device 803, then the packet is not passed on, but is decoded by second memory device 803 and the requested operation performed. One or more reply packets can then be generated by second memory device 803, which are sent on ring serial links 824 to third memory device 804, then to memory devices 805, 806 over return ring serial links 826 to return to host controller 820, which is the reply packet's destination. Host controller 820 can extract the data from the reply packet and sent it to the host, or verify that a write or other operation was performed successfully.

Serial packets, both requests from host controller 820 and replies from one of memory devices 802-806, travel over ring serial links 824, 826 in a clockwise direction around the ring of devices. A large number of memory devices may be inserted into the ring, limited by the number of bits in the packet's destination address, or by physical or timing limits. Ring serial links 824, 826 can be unidirectional PCI-express links, or PCI-XP, Serial Rapid IO, 10 Gbit Ethernet, Fibre Channel, or InfiniBand. Serial links may run at various rates, such as 2.5 Gbit/s, or multiples of 2.5 Gbps, such as 5 G or 10 Gbps.

The average latency is the same for all devices in the ring, when averaged over a round-trip of transactions, from the host and back to the host. One complete pass through the ring is required of most transactions between the host and a memory device, regardless of where on the ring the memory device is. For example, host controller 820 sends a serial packet to memory device 803, passing through one memory device 802. Memory device 803 responds, such as by sending back the read data, with a serial packet that passes through memory devices 804, 804, 806 before reaching host controller 820. While the packet sent from host controller 820 quickly reaches its destination memory device 803, the reply packet passes through many memory devices 804, 805, 806 on the return to host controller 820. The average for the round-trip is one complete loop of the ring. This constant average latency of one round trip reduces data-dependent performance, since the same packet latency occurs regardless of the data location on the ring. A more robust and predictable memory system is achieved.

FIG. 5 shows a multi-ring memory system of serial links in a ring. Rather than have a single large ring, the memory controller can support multiple rings. The number of memory devices per ring can be reduced, potentially increasing performance and allowing for parallel operations on different rings. A very high performance memory system can be constructed with multiple rings of memory devices.

Multi-ring memory controller 840 sends serial packets to memory devices in several rings. Multi-ring memory controller 840 sends requests in serial packets over ring serial links 834 to memory devices 842, 843, 844, 845, 846. One of memory devices 842, 843, 844, 845, 846 intercepts the serial packet, performs the memory operation requested, and generates one or more reply packets that are sent over ring serial links 834 and through the remaining ones of memory devices 842, 843, 844, 845, 846 to multi-ring memory controller 840.

Other rings of memory devices are also accessed by multi-ring memory controller 840. For example, for ring N, memory devices 862, 863, 864, 865, 866 are accessed by multi-ring memory controller 840 sending request packets over ring serial links 854. Ring serial links 834, 854 can be a high-speed serial link such as PCI-express, PCI-XP, serial rapid IO, Ethernet, FiberChannel, etc.

Memory devices 842, 843, 844, 845, 846 could be flash memory devices or could be other kinds of non-volatile memory devices such as phase-change memory (PCM) chips. Likewise, second-ring memory devices 862, 863, 864, 865, 866 could also be PCM devices rather than flash devices. One ring could have flash-memory devices, while another ring has PCM devices. Some rings could contain single-level-cell (SLC) NAND flash devices, with other rings could contain multi-level-cell (MLC) flash devices.

Having multiple rings allows multi-ring memory controller 840 to access different rings of memory devices in parallel. A very large, high-bandwidth memory system can be achieved. Individual rings can be relatively small, reducing the overall round-trip latency.

FIG. 6 shows a bypassing serial-link transceiver. Each of memory devices 842, 843, 844, 845, 846 (FIG. 4) contains bypassing transceiver 880. Receiver 878 connects to ring serial link 824 from the earlier device in the ring, while transmitter 882 drives ring serial link 824 that is connected to the next device in the ring.

Device ID checker 876 examines the destination ID of each serial packet and compares the packet's destination ID to the ID of the current memory device. When the packet's ID matches the device's ID, the serial packet is extracted from the ring. Receiving state machine 870 processes the serial packet, passing the data payload up to the memory device. The data payload may contain write data from the host, or a command from the host.

The current memory device performs the memory operation indicated by the command from the received serial packet, and generates one or more reply packets. The reply packets may contain data read from the memory device for a read command, or status information for a write or other command type. Various state machines and control logic in the memory device may generate these reply packets or their data payloads. Transmit state machine 872 serializes the reply packets to be transmitted, and may attach other packet information such as the destination ID of host controller 820.

Clock synchronizer and bypass logic 874 synchronizes the bits of reply packet to the transmit clock, and may multiplex bypassed packets with locally-generated reply packets. Data buffers (not shown) may be used to store packets that are delayed while other packets are transmitted by transmitter 882.

When device ID checker 876 finds that the destination ID of a serial packet the ID of the current memory device, the packet is not extracted from the ring. Instead, the packet is bypassed to clock synchronizer and bypass logic 874 and is re-transmitted to the next device in the ring by transmitter 882.

FIG. 7 is a layer diagram for communication over the serial bus to a serial flash-memory chip. Controller 20 generates and sends serial packets over the differential lines of input serial bus 24 to serial flash-memory chip 22. Another serial flash-memory chip 22′ in the ring generates reply packets that are sent over the differential lines of output serial bus 26 to controller 20.

The microcontroller, state machines, serial engine, or other logic in serial flash-memory chips 22, 22′ implement the functions of several layers of communication protocols. Serial packets using the PCI express protocol are generated by transaction layer 33 and data-link layer 35. Transaction layer 33 can append a header to the flash-memory or status data being transmitted, and can append error-check or recovery information such as a checksum. A packet sequence number and cyclical-redundancy-check (CRC) can be added by data-link layer 35. Data may be divided into multiple packets by the application software, transaction layer 33, or data-link layer 35 if needed.

Physical layer 37 handles physical transmission of the higher-level packets over the differential lines, and includes an electrical block with line drivers and receivers, and a logic block that can adjust bit timing, such as by bit stuffing and framing.

Controller 20 has similar layers, such as physical layer 36, data-link layer 34, and transaction layer 32. Serial engines can implement much of physical layers 36, 37, and perhaps some or all functions of data-link layers 34, 35. More sophisticated state machines or programmable logic or programs executed by microcontroller processors can implement functions of the higher-level transaction layers 32, 33.

FIG. 8 is a diagram of serial-packet formation by the protocol layers of FIG. 7. Serial packet 40 could be a reply packet generated by serial flash-memory chip 22′ with the flash data read from the flash-memory block. Data field 44 contains the flash-memory data requested by a read-request packet from controller 20. Status information from the flash-memory block could also be included in data field 44.

The transaction layer generates header 50 that is pre-pended to data field 44. A cyclical-redundancy-check (CRC) of data field 44 with header 50 can be generated by transaction layer 33 and attached as End-to-end CRC 54. The transaction layer packet of header 50, data field 44 and ECRC 54 is sent to data-link layer 35.

Data-link layer 35 may optionally divide long transaction-layer packets into several packets, and attaches sequence number 42 to indicate where the current packet belongs in the sequence of serial packets. Another checksum or link CRC can be added by data-link layer 35, LCRC 46 to form the data-link layer packet.

The physical layer can add framing fields 41, 48. Framing fields 41, 48 delineate the physical packets. The bits starting with framing field 41, sequence number 42, header 50 are serially transmitted before data field 44 and the remaining checksums and framing is transmitted over the differential lines of the serial bus.

FIG. 9 shows a transaction-layer packet. Transactions following the PCI Express protocol have requests and completions that are communicated by packets. The packet formed by the transaction layer is known as a transaction-layer packet (TLP).

The data read from the flash memory, or the status reported by the flash memory, is contained in data field 44. For requests from the external controller, data field 44 contains data to write to the flash memory. Some packets may not have data field 44. Bytes are converted to serial data and transmitted over the serial bus in increasing order. The lowest byte is shown on the left and the highest byte on the right in the diagrams.

ECRC 54 can be a checksum or other digest information about data field 44. ECRC 54 can be four bytes in one embodiment. ECRC 54 can be compared to a checksum generated by the receiver to detect transmission errors.

Header 50 is generated by the transaction layer and follows the PCI Express protocol. Header can be 12 or 16 bytes in length. The first four bytes are shown, since all transaction-layer packet headers begin with the same format of the first four bytes. Later bytes in header 50 can vary in definition depending on the type of packet.

Several bits in header 50 are reserved and shown as “R”. A 2-bit format field FMT[1:0] defines the overall format of the transaction-layer packet. When FMT[1] is 0, the packet contains no data (data field 44 is absent); when FMT[1] is 1, the packet contains data field 44. When FMT[0] is 0, header 50 has 12 bytes; when FMT[0] is 1, header 50 has 16 bytes. Requests with two FMT values can use either 32 bit or 64 bit addressing packet formats.

Type field TYP[4:0] indicates the packet type, such as read or write requests, configuration reads or writes, messages, and completion packets with or without data. The format field can be used in conjunction with the type field to further define the packet type. For example, write request packets contain data field 44 and thus have FMT[0]=1, while reads have no data and thus have FMT[0]=0. Other fields may be present in header 50.

A 10-bit length (LEN) field contains the length of data field 44 as a number of 32-bit double-words. Data field 44 is aligned to double-word boundaries. The length field is reserved when the transaction-layer packet has no data field 44.

FIG. 10 is a table of transaction-layer packet types used for communicating with serial flash-memory chips in a ring. Not all types of PCI Express packets are needed when communicating with serial flash-memory chip 22. Requests from the external controller to serial flash-memory chip 22 include memory-read, memory-write, configuration-read and configuration-write. Write request packets contain data field 44 and thus have FMT[0]=1, while reads have no data and thus have FMT[0]=0. Memory requests have type TYP[4:0] of 00000, while configuration requests have a type TYP[4:0] of 00101.

Serial flash-memory chip 22 responds to requests with completion packets. Completion packets have a type TYP[4:0] of 01010. Completion packets with data include data field 44 and thus have FMT[0]=1, while completion packets without data have no data field and thus have FMT[0]=0.

Message packets have a type TYP[4:0] of 10RRR, where the last 3 bits are reserved and can specify message routing information. These bits can also be used to select from among multiple chips for expansion such as in FIG. 13.

FIG. 11 is a table of request and response packets used for various flash-memory commands. The center column of the table shows the request packet type while the last column shows the response packet type. The request packets are mostly from the external controller, while the response packets are mostly from the serial flash-memory chip. Commands could be modified or extended for other kinds of memory devices, such as for phase-change memory (PCM) devices.

When the external controller wants to read a block of data from the serial flash-memory chip, it initiates the flash-read command by sending a memory-read-request packet to the serial flash-memory chip. The serial flash-memory chip decodes the request, reads the data from the flash-memory block, and sends the flash-memory data back to the external controller in data field 44 in a completion-with-data packet. This basic flash-read command is shown in the first row of the table. The external controller sends a memory-read packet (first row of FIG. 10) while the serial flash-memory chip responds with a completion-with-data packet (last row of FIG. 10).

After writing to the flash memory, the serial flash-memory chip itself can verify that the data was written correctly and set an error flag in a status register when an error or a data mis-match is detected. The serial flash-memory chip then sends a vendor-defined message back to the external controller indicating success or failure of the write operation.

The second row of the table shows a read for copy back command. The external controller sends a read-request packet to the serial flash-memory chip. The read-request packet has a data length that matches the size of the status register, such as a length of one. The serial flash-memory chip performs the read-for-copy-back operation to the memory array by reading the data of the corresponding row into an internal buffer. After this operation is completed, it then reads its status register and copies the status register's contents to data field 44 that is sent back in a completion-with-data packet.

An identifier (ID) register on the serial flash-memory chip can be read by the external controller. To perform the flash “read ID” command, the external controller sends a configuration read request packet. The serial flash-memory chip reads its ID register and sends the data back in data field 44 in a completion-with-data packet.

A flash reset command can be used to reset the serial flash-memory chip. The external controller sends a message request packet to the serial flash-memory chip. The message packet contains a command to reset the serial flash-memory chip. No response from the serial flash-memory chip is needed.

To program data into the flash memory, the external controller loads the new data into data field 44 of a memory-write-request packet. The serial flash-memory chip decodes the command in the packet and writes the data to its flash-memory block. The serial flash-memory chip sends a message request packet to the external controller once programming is complete.

The actual physical programming of the flash-memory cells may take a relatively long time. The cache-program flash command is faster since the data is first written to a buffer in the serial flash-memory chip, then programmed into the flash-memory cells. The serial flash-memory chip sends a message-request packet as soon as the data is loaded into the buffer, but before the data has been programmed into the flash memory cells. Thus this message-request packet is returned more quickly for the cache-program command than the message packet is returned for the program command. The message-request packet has no data for the basic cache-program command.

Sometimes an entire block of flash data is to be erased. The flash erase command is sent from the external controller as a message request packet with a pre-defined encoding of reserved or vendor-defined bits. The serial flash-memory chip decodes these bits and executes an erase of a block of flash data. An erase operation can take a relatively long time, so the serial flash-memory chip later sends a message-request packet to the external controller once erase is complete.

The status register on the serial flash-memory chip can be read by the external controller sending a configuration-read-request packet. The serial flash-memory chip copies the data from the requested status register to data field 44 of a completion-with-data packet that is sent back to the external controller.

FIG. 12 shows a generic format for a vendor-defined message packet. The PCI Express protocol allows for a vendor-defined message. The header of this message contains format and type fields in byte 0 that defines the packet type as described earlier. Bytes 1, 2, and 3 of the header contain the required fields such as the attributes and length of data field 44.

An identifier for the requester (the sender of the message packet) is loaded into bytes 4 and 5, while a tag and a message code can be placed in bytes 6 and 7 of the header. Bytes 8 and 9 are reserved for bus, device, and function identifiers, while bytes 10 and 11 contain an identifier for the vendor or manufacturer. The vendor can use bytes 12-15 of the header for information that the vendor defines. Bytes 12-15 are optional and are present when the format bit FMT[0] in byte 0 is 1. No data field 44 is used.

The vendor-defined message request packet can be sent by either the external controller or by the serial flash-memory chip. No response packet is needed. The vendor-defined message can be used for the flash-reset and flash-erase commands from the external controller, and for messages from the serial flash-memory chip that indicate final completion of all program and erase commands.

Vendor-define bytes 12-15 can be used to carry a 32-bit block address. For an erase command, bytes 12-15 carry the address of the block in flash memory to be erased. Since the entire block is erased, a full 32-bit address is not needed. The lowest bits of the 32-bit address can be used to define the type of flash command. For example, when address bits [2:0] are 001, the vendor-defined message packet requests a flash-erase operation, when address bits [2:0] are 000, the message is a flash-reset command, when address bits [2:0] are 010, the message is a completion-of-erase message from the serial flash-memory chip, and when address bits [2:0] are 011, the message is a completion-of-programming message from the serial flash-memory chip. The responses for Cache and Copy-Back Program commands can be defined similarly.

The completion status of an erase or program operation can be carried in bytes 12-15 for messages from the serial flash-memory chip. One of the bits in bytes 12-15 can be designated to carry a pass/fail flag. To enable pipeline operation, the program address is sent back to the external controller in bytes 12-15. Then bit 3 of the 32 bits can be used for the pass/fail status. The other bits can be used for the high-order program address.

FIG. 13 shows a header for a memory-request packet. Memory request packets are sent by the external controller and can request a read or a write. Byte 0 contains the format and type fields, which are set to one of the memory read or write values in the first two rows of FIG. 10. The format bit FMT[1] is 0 for read and 1 for write operations.

The length field in bytes 2, 3 contains the length of data field 44 in double-words. The requester ID of the external controller is contained in bytes 4, 5, while the address of the data being read or written is placed in bytes 8-11. Byte-enables for the first 32 bit data and last 32 bit data being written can be placed in byte 7. A tag can be placed in byte 6 and can uniquely identify a transaction when combined with the requester ID.

Because of the first and last byte enables in byte 7, the lower 2 address bits are not used for addressing. These lower 2 address bits can be used to carry other information. For example, address bit 0 can be set to 1 for the read-with-copy-back operation and set to 0 for the normal read operation.

For write operations, address bits ADDR[1,0] can be set to 00 for the flash-program operation, 01 for the cache-program operation, and 10 for the copy-back-program operation. Rather than use the lower address bits, other reserved bits could be used for operation encoding.

FIG. 14 shows a header for a completion packet. Completion packets are generated by the serial flash-memory chip and sent back to the external controller in response to a request from the external controller.

Byte 0 contains the format and type fields, which are set to 01010 for completion packets, as shown in the last two rows of FIG. 10. The format bit FMT[1] is 0 for read and 1 for write operations. Read operations do not have data in their requests.

The length field in bytes 2, 3 contains the length of data field 44 in double-words. Some completion packets have no data and their length is set to 0. Completion-with-data packets have a length of 1 or more. The completer ID of the serial flash-memory chip is contained in bytes 4, 5, while the completion status and byte count may be placed in bytes 6-7.

The requester ID of the external controller is contained in bytes 8, 9, while the low-order address or byte-enables of the data being read or written is placed in byte 11. A tag can be placed in byte 10 for uniquely identifying the transaction.

FIG. 15 shows a header for a configuration-request packet. Configuration-request packets are sent by the external controller to request reading or writing of a configuration register on the serial flash-memory chip. Byte 0 contains the format and type fields, which are set to the configuration packet values in the third and fourth rows of FIG. 10, TYPE[4:0]=00101. The format bit FMT[1] is 0 for a read request and 1 for write operations.

The length field in bytes 2, 3 contains the length of data field 44 in double-words. The requester ID of the external controller is contained in bytes 4, 5. Byte-enables for the data being written can be placed in byte 7. A tag can be placed in byte 6.

Identifiers for the serial bus, device, and function can be placed in bytes 8, 9. These identifiers can be generated by the external controller at run-time.

The serial flash-memory chip may have several configuration registers. An identifier for the configuration register in serial flash-memory chip can be placed in the register number field of byte 11. For example, register number 0 can be the ID register while register number 1 can be the status register. The flash read-ID command has its register number field set to 0 while the flash read-status command has its register number field set to 1.

The extension bits for the register number in byte 10 can be used if a large number of configuration registers are accessible in the serial flash-memory chip.

FIG. 16 shows packing of burst data. One write request may contain many double-words of data in its data field. The length in the packet header is set to the number of double-words in the data field. The entire block of data bytes are written to the flash memory as a burst write using a single flash-write operation requested by the external controller.

Sometimes not all bytes in the block of data need to be written. For example, only 5 of the first 8 bytes need to be written, only 3 of the second 8 bytes, and only 4 of the third 8 bytes need over-writing, etc. Sending all 8 bytes of each pair of double-words is inefficient since the packet size is large enough to contain all bytes even though many of the bytes do not really need to be written. Sending only the bytes that need to be written can reduce packet size and bandwidth used on the serial bus.

Byte masks can be inserted into the data stream in data field 44. In the embodiment shown in FIG. 16, a byte mask is inserted for every 8 bytes of memory locations. Each of the 8 bits in the byte mask indicates the presence of one of the 8 bytes of memory locations in the flash memory.

In the example of FIG. 16, the initial byte in data field 44 is a byte mask with a value of 00110100. Since bits 5, 4, and 2 are set, these bytes are skipped. Five bytes follow the initial byte mask with the data to write for bytes 0, 1, 3, 6, and 7 of the first 8 bytes of flash memory addressed by the request packet. These five data bytes are followed by the second byte mask, which indicates which of the next 8 bytes of the flash memory are to be written.

Since data for bytes 5, 4, and 2 are not in data field 44, a net savings of 2 bytes occurs for the first 8 bytes. This is a compression of 2/8 or 25% using packed data in data field 44.

Packing of data field 44 using data bytes can be indicated in the packet header, or could be activated by setting a packed-data mode bit in a configuration register in serial flash-memory chip. A different packet type can be defined for packed data, such as type TYPE[4:0] being 11000 for a packed memory write while type TYPE[4:0] being 00000 is for a non-packed memory write or read.

Alternate Embodiments

Several other embodiments are contemplated by the inventors. For example different numbers of rings could be supported by different kinds of multi-ring memory controllers. The number and type of memory devices in each ring may vary. Some rings may have flash memory devices while other rings have dynamic RAM devices or phase-change memory devices.

Rather than use a microcontroller, the serial flash-memory chip could use one or more state machines or specialized controllers or logic. The microcontroller could include internal program memory in RAM, ROM, or flash memory, and could contain an internal direct-memory access (DMA), I/O or flash-memory controller, address management logic, and internal buses.

The serial engine or microcontroller may encode the bytes of data in a variety of ways for transmission. Other formats of packed data can be used. Packet and header formats can vary, and some fields may hold dummy data. Rather than use 32-bit addressing, 64-bit addressing could be substituted.

Different numbers and arrangements of flash storage blocks can be included. Rather than use PCI Express, other serial buses may be used such as USB, Firewire (IEEE 1394), Serial ATA, Serial Attached Small-Computer System Interface (SA-SCSI), Serial Rapid IO, etc. Additional or fewer pins could be used for the interface.

The microcontroller or state machine components such as the serial engine, DMA, flash-memory controller, transaction manager, and other controllers and functions can be implemented in a variety of ways. Functions can be programmed and executed by the microcontroller's CPU or other processor, or can be implemented in dedicated hardware, firmware, or in some combination. Many partitioning of the functions can be substituted.

Other packet types or variations of these types can be defined for special purposes. Wider or narrower internal data buses and flash-memory blocks could be substituted, such as 8, 16, 32, 64, 128, 256-bit, or some other width data channels. Alternate bus architectures with nested or segmented buses could be used internal or external to the microcontroller. Two or more internal buses can be used in the microcontroller to increase throughput. More complex switch fabrics can be substituted for the internal buses.

The flash mass storage blocks can be constructed from any flash technology including NAND, NOR, AND, single-level-cell (SLC) or multi-level-logic (MLC) memory cells. Data striping could be used with flash mass storage blocks in a variety of ways, as can parity and error-correction code (ECC). The serial flash-memory chip can be integrated with other components or can be a stand-alone chip. Different flash commands may be used for different types of flash-memory blocks. Chip pins can be flat leads, solder balls, or many other equivalents.

The background of the invention section may contain background information about the problem or environment of the invention rather than describe prior art by others. Thus inclusion of material in the background section is not an admission of prior art by the Applicant.

Any methods or processes described herein are machine-implemented or computer-implemented and are intended to be performed by machine, computer, or other device and are not intended to be performed solely by humans without such machine assistance. Tangible results generated may include reports or other machine-generated displays on display devices such as computer monitors, projection devices, audio-generating devices, and related media devices, and may include hardcopy printouts that are also machine-generated. Computer control of other machines is another a tangible result.

Any advantages and benefits described may not apply to all embodiments of the invention. When the word “means” is recited in a claim element, Applicant intends for the claim element to fall under 35 USC Sect. 112, paragraph 6. Often a label of one or more words precedes the word “means”. The word or words preceding the word “means” is a label intended to ease referencing of claim elements and is not intended to convey a structural limitation. Such means-plus-function claims are intended to cover not only the structures described herein for performing the function and their structural equivalents, but also equivalent structures. For example, although a nail and a screw have different structures, they are equivalent structures since they both perform the function of fastening. Claims that do not use the word “means” are not intended to fall under 35 USC Sect. 112, paragraph 6. Signals are typically electronic signals, but may be optical signals such as can be carried over a fiber optic line.

The foregoing description of the embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto. 

1. A multi-ring serial-bus memory system comprising: a multi-ring memory controller for generating request packets that contain flash commands, and for receiving completion packets in response to the flash commands; a first-ring serial link output of the multi-ring memory controller for outputting request packets to a first ring; a first-ring serial link input of the multi-ring memory controller for receiving completion packets from the first ring in response to request packets sent through the first-ring serial link output; a first ring of serial flash-memory chips, each serial flash-memory chip in the first ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the first ring is connected to the serial output of a following serial flash-memory chip in the first ring, and wherein the serial input of an initial serial flash-memory chip in the first ring is connected to the first-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the first ring is connected to the first-ring serial link input; a second-ring serial link output of the multi-ring memory controller for outputting request packets to a second ring; a second-ring serial link input of the multi-ring memory controller for receiving completion packets from the second ring in response to request packets sent through the second-ring serial link output; a second ring of serial flash-memory chips, each serial flash-memory chip in the second ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the second ring is connected to the serial output of a following serial flash-memory chip in the second ring, and wherein the serial input of an initial serial flash-memory chip in the second ring is connected to the second-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the second ring is connected to the second-ring serial link input; and a bypassing transceiver in each serial flash-memory chip, the bypassing transceiver comparing a device identifier of a request packet to a current device identifier for the serial flash-memory chip and bypassing and retransmitting the request packet through the serial output when the device identifier mismatches the current device identifier, and decoding the request packet and processing a flash command to generate a completion packet for transmission over the serial output when the device identifier matches the current device identifier, whereby request packets and completion packets are bypassed by serial flash-memory chips in rings connected to the multi-ring memory controller.
 2. The multi-ring serial-bus memory system of claim 1 wherein each serial flash-memory chip comprises: a flash-memory array of electrically-erasable programmable read-only memory (EEPROM) cells; row and column decoders for selecting EEPROM cells in the flash-memory array for reading, writing, or erasing in response to a flash address; a serial-bus interface to the serial input and to the serial output of the serial flash-memory chip, the serial-bus interface connected to pins of the serial flash-memory chip, for receiving serial data from the serial input and for transmitting serial data over the serial output; a serial engine, coupled to the serial-bus interface, for converting serial data from the serial input to parallel data; an internal controller, coupled to the serial engine, for responding to flash commands sent to the serial input in request packets, and for generating completion packets that are sent through the serial output in response to the flash commands; and data buffers, coupled between the flash-memory array and the internal controller, for buffering data read from the EEPROM cells in response to the internal controller decoding a read flash command in a read-request packet, the data being loaded into a data payload of a completion packet; wherein the internal controller programs data into the EEPROM cells through the data buffers in response to a program flash command in a write-request packet received over the serial input, whereby the serial flash-memory chip has a serial-packet interface for commands, address, and data.
 3. The multi-ring serial-bus memory system of claim 2 wherein the write-request packet contains a program flash command; wherein the internal controller generates a vendor-defined message packet with a completion status for transmission through the serial output after the EEPROM cells have been programmed, the vendor-defined message packet being part of a different serial-bus transaction than the write-request packet that initiated programming of the EEPROM cells; whereby the vendor-defined message packet is generated after completion of a program operation.
 4. The multi-ring serial-bus memory system of claim 3 wherein the write-request packet contains a cache-program flash command; wherein the internal controller generates a message-request packet for transmission through the serial output before completion of programming the EEPROM cells, the message-request packet being part of a same serial-bus transaction for the write-request packet that initiated programming of the EEPROM cells.
 5. The multi-ring serial-bus memory system of claim 4 wherein an erase flash operation is initiated by the internal controller receiving an erase flash command in a vendor-defined message packet received by the serial input; wherein the internal controller generates a second message packet for transmission through the serial output after completion of the erase flash operation, the second message packet being part of a different serial-bus transaction than the vendor-defined message packet that initiated erasing of the EEPROM cells; whereby the second message packet is generated after completion of an erase flash operation.
 6. The multi-ring serial-bus memory system of claim 5 wherein the internal controller resets the serial flash-memory chip in response to a reset-flash command in the vendor-defined message packet received by the serial input.
 7. The multi-ring serial-bus memory system of claim 6 wherein the internal controller generates a completion packet with a copy of a status register as a data payload in response to a configuration-read-request packet received by the serial input; wherein the status register contains status flags or an identifier of the serial flash-memory chip.
 8. The multi-ring serial-bus memory system of claim 7 wherein each packet sent through the serial output or received by the serial input contains a header having a type field and a format field that define a type and a format for each packet, wherein packet types include the read-request packet, the write-request packet, and a message packet sent to the serial flash-memory chip, and the completion packet and a message packet generated by the internal controller.
 9. The multi-ring serial-bus memory system of claim 8 wherein the write-request packet contains a data payload containing data to program into the EEPROM cells, but the read-request packet contains no data payload; wherein the completion packet generated in response to the read-request packet contains a data payload containing data read from the EEPROM cells.
 10. The multi-ring serial-bus memory system of claim 9 wherein the read-request packet contains the flash address that is sent to the row and column decoders to select data in the EEPROM cells for reading; wherein the write-request packet contains the flash address that is sent to the row and column decoders to select EEPROM cells for programming.
 11. The multi-ring serial-bus memory system of claim 3 wherein a serial link between the serial output of the prior serial flash-memory chip and the serial input of the following serial flash-memory chip is a Universal-Serial-Bus (USB), a Peripheral Component Interconnect (PCI) Express bus, a Firewire IEEE 1394 bus, a Serial ATA bus, or a Serial Attached Small-Computer System Interface bus.
 12. The multi-ring serial-bus memory system of claim 4 wherein the flash address has lower address bits that indicate when a flash command conveyed by the request packet is the cache-program flash command, the program flash command, or a copy-back-program flash command; wherein the lower address bits are not necessary to uniquely locate EEPROM cells within the flash-memory array, whereby lower address bits in the flash address select a type of write operation.
 13. The multi-ring serial-bus memory system of claim 3 wherein the bypassing transceiver further comprises: a receiver coupled to the serial input, for receiving differential serial data; a transmitter coupled to the serial output, for sending differential serial data; a device ID checker for comparing the device identifier of the request packet to the current device identifier for the serial flash-memory chip; a receive state machine, coupled to receive serial data from the Device ID checker when the device identifier matches the current device identifier; a transmit state machine for transmitting serial data generated by the serial flash-memory chip in response to the flash command in the request packet; and a clock synchronizer and bypass logic, coupled to the transmit state machine and coupled to the device ID checker, for bypassing request packets and completion packets to the transmitter when the device identifier mismatches the current device identifier, and for synchronizing bypassed packets and serial data from the transmit state machine for transmission by the transmitter.
 14. The multi-ring serial-bus memory system of claim 13 further comprising: a third-ring serial link output of the multi-ring memory controller for outputting request packets to a third ring; a third-ring serial link input of the multi-ring memory controller for receiving completion packets from the third ring in response to request packets sent through the third-ring serial link output; a third ring of serial flash-memory chips, each serial flash-memory chip in the third ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the third ring is connected to the serial output of a following serial flash-memory chip in the third ring, and wherein the serial input of an initial serial flash-memory chip in the third ring is connected to the third-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the third ring is connected to the third-ring serial link input, whereby the multi-ring memory controller drives request packets to three rings of the serial flash-memory chips.
 15. A serial-ring non-volatile memory sub-system comprising: a serial-ring memory controller means for generating request packets that contain non-volatile-memory commands, and for receiving completion packets in response to the non-volatile-memory commands; wherein the serial-ring memory controller means further comprises a first-ring serial link output means for outputting request packets to a first ring and a first-ring serial link input means for receiving completion packets from the first ring in response to the request packets sent through the first-ring serial link output means; a first ring of serial non-volatile memory devices, each serial non-volatile memory device in the first ring having a serial input and a serial output and a non-volatile-memory array, wherein the serial output of a prior serial non-volatile memory device in the first ring is connected to the serial output of a following serial non-volatile memory device in the first ring, and wherein the serial input of an initial serial non-volatile memory device in the first ring is connected to the first-ring serial link output means, and wherein the serial output of a last serial non-volatile memory device in the first ring is connected to the first-ring serial link input means; and bypassing transceiver means, in each serial non-volatile memory device, for comparing a device identifier of a request packet to a current device identifier for the serial non-volatile memory device and bypassing and retransmitting the request packet through the serial output when the device identifier mismatches the current device identifier, and for decoding the request packet and processing a non-volatile-memory command to generate a completion packet for transmission over the serial output when the device identifier matches the current device identifier, whereby the first ring of serial non-volatile memory devices is controlled by the serial-ring memory controller means.
 16. The serial-ring non-volatile memory sub-system of claim 15 wherein the serial-ring memory controller means further comprises a second-ring serial link output means for outputting request packets to a second ring and a second-ring serial link input means for receiving completion packets from the second ring in response to request packets sent through the second-ring serial link output means; a second ring of serial non-volatile memory devices, each serial non-volatile memory device in the second ring having a serial input and a serial output and a non-volatile-memory array, wherein the serial output of a prior serial non-volatile memory device in the second ring is connected to the serial output of a following serial non-volatile memory device in the second ring, and wherein the serial input of an initial serial non-volatile memory device in the second ring is connected to the second-ring serial link output means, and wherein the serial output of a last serial non-volatile memory device in the second ring is connected to the second-ring serial link input means; whereby request packets and completion packets are bypassed by serial non-volatile memory devices in rings connected to the serial-ring memory controller means.
 17. The serial-ring non-volatile memory sub-system of claim 16 wherein each serial non-volatile memory device comprises: serial-bus interface means for receiving serial packets from the serial input and for transmitting serial packets to the serial output; wherein the serial packets comprise a memory-read-request packet, a memory-write-request packet, a configuration-read-request packet, and an input message packet input to the serial non-volatile-memory device, and a completion packet and an output message packet output from the serial non-volatile-memory device; non-volatile memory means for storing data in non-volatile memory cells that do not lose data when power is removed; controller means, coupled to the non-volatile memory means and to the serial-bus interface means, for performing operations identified by commands in the serial packets, the operations including: reading data from the non-volatile memory means at a non-volatile address included in a header for the memory-read-request packet to generate a data payload for the completion packet; writing data to the non-volatile memory means at the non-volatile address included in a header for the memory-write-request packet, the data being sent in a data payload in the memory-write-request packet; reading a status from a configuration register identified by a header in the configuration-read-request packet to generate a data payload for the completion packet; erasing a block of memory in the non-volatile memory means in response to an erase indicator in a header in the input message packet and generating the output message packet once erasing is completed; and resetting the serial non-volatile-memory device in response to a reset indicator in a header in the input message packet, whereby operations are performed by the serial non-volatile-memory device in response to commands in serial packets received over the serial input include generation of completion packets with the data payload read from the non-volatile memory means.
 18. The serial-ring non-volatile memory sub-system of claim 17 further comprising: transaction-layer means, coupled to the controller means, for generating the completion packet by attaching a completion-packet header to the data payload, and for generating the output message packet by generating a message header indicating a completion status; data-link layer means, coupled to the controller means, for encapsulating a transaction-layer packet generated by the controller means by adding a sequence number to a header and a checksum to generate a data-link packet; and physical-layer means, in the serial-bus interface means, for framing the data-link packet for transmission over the serial output.
 19. The serial-ring non-volatile memory sub-system of claim 15 wherein the non-volatile memory means comprises flash-memory cells or phase-change-memory cells.
 20. A Peripheral Component Interconnect (PCI) Express flash-memory serial-ring system comprising: a multi-ring memory controller for generating request packets that contain flash commands, and for receiving completion packets in response to the flash commands; a first-ring serial link output of the multi-ring memory controller for outputting request packets to a first ring; a first-ring serial link input of the multi-ring memory controller for receiving completion packets from the first ring in response to request packets sent through the first-ring serial link output; a first ring of serial flash-memory chips, each serial flash-memory chip in the first ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the first ring is connected to the serial output of a following serial flash-memory chip in the first ring, and wherein the serial input of an initial serial flash-memory chip in the first ring is connected to the first-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the first ring is connected to the first-ring serial link input; a second-ring serial link output of the multi-ring memory controller for outputting request packets to a second ring; a second-ring serial link input of the multi-ring memory controller for receiving completion packets from the second ring in response to request packets sent through the second-ring serial link output; a second ring of serial flash-memory chips, each serial flash-memory chip in the second ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the second ring is connected to the serial output of a following serial flash-memory chip in the second ring, and wherein the serial input of an initial serial flash-memory chip in the second ring is connected to the second-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the second ring is connected to the second-ring serial link input; a bypassing transceiver in each serial flash-memory chip, the bypassing transceiver comparing a device identifier of a request packet to a current device identifier for the serial flash-memory chip and bypassing and retransmitting the request packet through the serial output when the device identifier mismatches the current device identifier, and decoding the request packet and processing the flash command to generate a completion packet for transmission over the serial output when the device identifier matches the current device identifier, wherein each serial flash-memory chip comprises: a flash memory array of non-volatile electrically-erasable programmable read-only memory (EEPROM) cells; address decoders, receiving a flash address, the address decoders selecting a subset of the EEPROM cells for reading, writing, or erasing; a high-voltage generator for generating elevated voltages above a power-supply voltage for programming and erasing the EEPROM cells; data buffers for storing data being written to the EEPROM cells; a command register receiving a non-volatile-memory command; control logic, responsive to the non-volatile-memory command in the command register, for controlling reading, writing, and erasing of the EEPROM cells; a serial interface to external pins of the PCI Express flash-memory chip that connect to the serial input and to the serial output that are externally connected to different external devices, the serial interface having a physical layer; wherein the serial input connects to half of a PCI Express serial bus having differential data lines that carry data serially; wherein the serial output connects to half of a PCI Express serial bus having differential data lines that carry data serially; a controller, connected between the serial interface and the command register and data buffers, the controller comprising: a data-link layer that encapsulates transaction-layer packets for transmission over the serial output after framing by the physical layer; a transaction layer that generates headers to attach to data payloads to generate the transaction-layer packets; read operation means, responsive to a memory-read-request packet received by the serial input having a header with the flash address, for sending a read command to the command register and sending the flash address to the address decoders, and transferring data read from the EEPROM cells from the data buffers to the transaction layer as a data payload, the transaction layer attaching the data payload to a header to generate a completion packet with the read data, the completion packet being sent over the serial output as a response to the memory-read-request packet; program operation means, responsive to a memory-write-request packet received over the serial input having a header with the flash address, for sending a write command to the command register and sending the flash address to the address decoders, and transferring data write from a data payload of the memory-write-request packet to the data buffers for writing to the EEPROM cells; erase operation means, responsive to a message packet received over the serial input having a header with an erase indicator, for sending an erase command to the command register, and generating a message packet for transmission over the serial output once the EEPROM cells have been erased; and reset operation means, responsive to a message packet received over the serial input having a header with a reset indicator, for sending a reset command to the control logic to reset the control logic and to reset the controller, whereby operations indicated by commands in serial packets received over the serial input are executed and data is returned in data payloads of serial packets. 